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5 NEAR-INFRARED DISGUISE DETECTION 

Reference to Related Applications 

This application is a contmuation in part of U.S. Patent Application No. 
09/389,925 ffled 3 September 1999 and claims the benefit of U.S. Provisional 
10 Application No. 60/210^80, filed 8 June 2000, v/hetcm such documents are 
incorporated herein by reference. 

Background of the Inventioo 

The present invention pertains to detection systems and methods. More 
15 particularly, the present iavention pertains to detection systems and methods 
using the near-infirared spectrum for the detection of, for example, disguised 
persons. 

In certain situations, disguise detection is of paramount importance. For 
example, in high-end security applications, e.g., surveillance of an embassy 

20 perimeter \^ere there is a need to know if disguised terrorists are staking out a 
facility, disguise detection is required. Sophisticated systems for early detection 
and identification of individuals at a distance need to be developed and 
implemented for fiiture security systems. 

Sophisticated terrorists use both imtural (e.g., daricness, weather, 

25 blending into the background) and man-made (e.g., heavy make-up, artificial 
face parts, add-on hair, etc.) deception and disguise techniques to avoid 
identification. Currently, systems that can determine whether an mdividual is 
wearing a facial disguise are lackmg. Therefore, face identification processes 
and systems that have the capability to identify a particular human face cannot 

30 even be initiated, or even if such processes are initiated, the processes do not 
know of the possible disguise being used by the individual. Therefore, the face 
identification processes are easily rendered mefifective. As such, the mere 



1 
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detection of a disguised individual on the perimeter is highly valuable to 
security forces. 

One article entitled "Disguise detection and identification using infirared 
imagery," by FJ. Prokoski, Proceedings ofSPJE, Optics, and Images inlaw 

5 Enforcement II, A.S. Hecht, Ed., Arlington, pp. 27-3 1, Virginia, May 1982, 
describes a disguise detection system that uses facial thermograms in the 
thermal infrared spectrum for the detection of disguises and in positive 
identification of known individuals. However, thermal infirared radiation does 
not transmit effectively through glass, e.g., so as to allow for detection of 

10 disguises within vehicles. 

Other portions of the spectrum are also ineffective for use in disguise 
detection. For example, even thougji the visible spectrum has been used in 
imaging and detecting individuals, such visible spectrum systems or methods 
are not effective for disguise detection. Disguises cannot be detected in the 

1 5 visible band because by definition such disguises are meant to cheat die human 
eye and the other sensors that operate in the same wavelengtL In otiier words, 
in the visible spectrum, artificial materials disguising an individual are not 
detectable. 

Further, for example, the lower portion of the electromagnetic spectrum 
20 consists of gamma rays, x-rays, and radiation in the ultra-violet range. 

Radiation of such wavelengflis is haimfid. Thus, such radiation that is typically 
useful in a controlled manner, e.g., for medical ^plications, cannot generally be 
used for disguise detection. 

At the far end of the electromagnetic spectrum, there is microwave and 
25 radio radiation. Hiis range of the spectrum has recentiy started to be exploited 
for imaging piHposes. Sensors operate in an active or in passive mode. The 
major advantage of such longer wavelengths is that they can penetrate clouds, 
fog, and rain for producing weather independent imaging results. However, the 
technology for such wavelengths is new and prohibitively expensive. Also, the 
30 sensors available for detection in this range of radiation are extremely large and 
have very low resolution. 
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Related efforts by others, for example, in the field of detecting occupants 
in vehicles, such as for gathering statistics in high occxq)ancy vehicle lanes 
which can be used for road construction planning, have involved the use of a 
near-infrared camera (i.e., in the range of 0.55 to 0.90 micron) and a near- 

5 infrared illimiination source in the same range of wavelengths. One reason for 
using near-infi:ared sensing is the ability to use non-distracting illumination at 
night Illumination at nighttime enhances the quality of the image. However, it 
appears that this choice of range of wavelengths is not q)propriate because of its 
close proximity to the visible spectrum. Experiments have shown that the 

10 human eye has some sensitivity to this range of near-infrared wavelengdis, 
however small. Another reason for this approach, was to bypass problems 
caused by solar illumination during daytime, such as glare from glass of 
vehicles. Nevertheless, particularly in this range of the spectrum (i.e., 0.55 to 
0.9 micron) solar illumination is still substantial and the associated glare can be 

15 reduced only through the use of i)olarizing filters. 

Further, in more general terms, related art projects that involve imaging 
usually adopt the use of visible spectrum cameras which as desoibed above, are 
ineffective in disguise detection. One strong point of the visible spectrum is 
that the relevant imaging sensors are very advanced and at the same time very 

20 economical. Visible spectrum cameras have a particular advantage in terms of 
speed, which is an important consideration, for example, in detecting occupants 
in vehicles, where vehicles are moving at rates of speed of 65 mph. These 
cameras can also have very high resolution, resulting in veiy clear images imder 
various conditions. However, imfortunately, in addition to not detecting 

25 disguised individuals, there are other serious problems with the visible spectrum 
approach. For instance, some vehicles have heavily tinted window glass to 
reduce glare from solar illumination. This glass is nearly opaque to visible 
spectrum cameras. Also, visible spectrum cameras do not have operational 
capability during nighttime. 

30 Visible spectrum or very near infrared detection of people in vehicles 

has not been very successfiil under most conditions. The glare and other 
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problems caused by solar iUununation, such as through vehicle windows, has 
prevented effective detection of vehicle occupants. Also, environmental 
conditions like weather obscure detection. People appear to have darker or 
lighter faces, depending on the characteristics of the people being detected, and 
5 on die incident angle and intensity of deliberate or incidental illumination. 



Summary of the Invention 

Various ^bodiments of Ihe present invention provide solutions to one 
or more problems existing with respect to detection systems and methods, and 

10 in particular disguise detection systems and methods. Such embodiments may 
provide one or more of the following advantages. For example, disguised faces 
may be detected within vehicles through window glass thereof. Further, the 
present invention provides a simple thresholding system that can deliver 
excellent disguise detection results, hi addition, the existence of specific 

15 materials used for disguise purposes may be identified. 

The present invention capitalizes on the unique and universal properties 
of the natural human skin and/or natural human hair in the upper band of the 
near-infrared spectrum. Some embodiments ofthemediods according to the 
present invention include one or more of the following: detecting reflection 

20 from at least one portion of a head of a human body in at least a portion of an 
upper band of the near-infrared spectrum (e.g., at least a portion within the 
range of 1.4 pm and greater in the upper band of the near-infrared spectrum); 
determining the presence of an artificial material associated with the head of the 
human body based on the detected reflection; detecting reflection from at least a 

25 skin portion of the head of the human body; detecting reflection from at least a 
hair portion of flie head of the human body; determining the presence of an 
artificial material associated with the head of the human body by displaying to a 
user a representation of the detected reflection; determining the presence of an 
artificial material associated with the head by generating data representative of 

30 the detected reflection and comparing the data to at least one threshold reference 
reflection level; identifying one or more artificial materials associated with the 
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head; basing the threshold reference reflection level(s) on a level of reflection of 
natural skin of the human body, the level of reflection of natural hair of the 
human body, or the level of reflection of one or more artificial materials; using 
an illimiination source matched to the upper band of tiie near-infrared spectrum 

5 detected to illuminate the head of the himian body, controlling the illumination 
source based on a detected illumination level to maintain the desired 
illumination level on the head of the human body. 

Some embodiments of a disguised person detection system include one 
or more of the following features: a detector ^paratus operable to detect 

10 reflection fiom at least aportion of the head of the human body in at least a 
portion of an upper band of the near-inj&ared spectrum; an indication apparatus 
operable to provide a user with information as to the presence of an artificial 
material associated with the head of the hiraian body based on the detected 
reflection (e.g., wherein the indication apparatus comprises a display operable to 

1 5 provide a representation of the detected reflection and/or wherein the indication 
apparatus may comprise circuitry operable to compare information 
representative of the deflected reflection to one or more threshold reference 
reflection levels, wherein the flireshold reference reflection levels may be based 
on a level of reflection of one or more artificial materials, the natural skin of the 

20 human body, the natural hair of the human body, etc.); an illumination source 
matched to the at least a portion of the upper band of the near-infrared spectrum 
and positioned to illuminate at least a portion of the head of the human body; a 
detector operable to detect an illumination level proximate the head so as to 
provide information to circuitry operable to control the illumination source 

25 based on the detected illumination level such that a desired illummation level 
can be maintained. 

Further, in other embodiments of the present invention, a detection 
method may include detecting reflection from a scene in at least a portion of at 
least one band of the near-infi^red spectrum, and thereafter, determining the 

30 presence of a head of the human body in the scene. The features of the disguise 
detection methods and/or system described above may then be used to 
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detennine the presence of an artificial material associated with the detected 
head. 

The above sununaiy of flie present invention is not intended to describe 
each embodiment or every implementation of the present invention. 
5 Advantages, together with a more complete nnderstandii^ of the invention, vrill 
become apparent and ^predated by referring to the following detailed 
description and claims taken in conjunction with the accompanying drawings. 



Figure 2A illustrates a co-registration scheme for two cameras. 
Figure 2B shows an alternate embodiment for co-registration of the 
cameras. 

Figure 3 is a histogram of the number of pixels versus spectral power for 
15 an image frame. 

Figure 4 is a graph of the electromagnetic (EM) spectrum. 

Figure 5 reveals the infrared transmittance characteristics for an 
automobile windshield 

Figure 6 reveals the infiafed transmittance characteristics for an 
20 automobile side window. 

Figure 7 is a grq)h showing the percentage of reflectance for Caucasian 
males of light and dark complexions. 

Figure 8 is a gr^h showing the percentage of reflectance for Asian 
males of light and dark complexions. 
25 Figure 9 is a graph showing the percentage of reflectance for black males 

of light and dark complexions. 

Figure 10 is a graph showing a comparison of reflectance for Ught and 
dark skin. 

Figure 1 1 is a graph of reflectance for cotton, wood and polyamide. 
30 Figure 12 is a graph of reflectance for distilled water. 



10 



Brief Description of fte Embodiments 

Figure 1 shows a near-infrared frision system for detecting humans. 



6 
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Figure 13 shows a layout for determining the speed characteristics of a 
human detection system. 

Figures 14A-B shows the appearance of an undisguised individual in the 
visible spectrum and in the iipper band of the near-infrared spectrum, 
5 respectively. 

Figures 1 5 A-B show the appearance of a disguised individual m the 
visible spectrum and in the xsppcr band of the near-infrared spectrum, 
respectively. 

Figure 16 shows one illustrative embodiment of a disguise detection 
10 system according to the present invention. 

Figure 17 is a graph of reflectance for natural human hair. 
Figure 1 8 is a graph of reflectance for a true human hair toupee. 
Figure 19 is an illustrative embodiment of one disguise detection method 
according to the present inventioa 
15 Figure 20 is yet another alternate embodiment of a disguise detection 

method according to the present invention, 

Detafled Descriotian of the Embodiments 

Figure 1 shov^ a basic layout of a near-infrared fusion system 10 for 
20 detecting humans. It is a dual-band imaging system. Two co-registered 

cameras 11 and 12 sense the image of, for instance, a face 13 of a human being. 
Camera 11 has a spectral sensitivity of 0.8 to 1.4 microns. Camera 12hasa 
spectral sensitivity of 1 .4 to 2.2 microns. Slightly shorter or longer ranges can 
also yield acceptable detection results. The 1 .4 micron threshold point between 
25 the two bands of spectral sensitivity is a preferable demarcation point for the 
dual-band system 10, but may be another value as ^propriate. Each of the 
camera sensitivity band ranges can cross somewhat the 1 .4 micron wavelength 
without diminishing the human detecting ability of system 10. 

The quality of the imaging signals from cameras 1 1 and 12 remain high 
30 even during overcast days and at nighttime, because the scene being scanned by 
cameras 1 1 and 12, can be illuminated with an eye-safe near-infrared illuminator 
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14. Since the eye is not sensitive to the near-infrared spectrum, system 10 can 
remain stealthy all of the time, whether in a detection mode or not. Ideally, the 
camera at the lower band range (0.8 to 1 .4 microns) should be an im^e 
intensifier. Therefore, the illuminator's spectral emission specification needs to 

5 match only with the upper band range (1.4 to 2.2 microns). The iq)per band 
range is qmte far from the visible spectrum and illumination in these 
wavelragths is safe even for highway applications. Near-infrared cameras 1 1 
and 12 provide clear imaging signals even in foul weather conditions such as 
hazy conditions. These particular infrared bands of detection and illumination 

10 provide for sufficient light transmission through windshields, side windows, 
fog, and darkness. This permits adequate detection of humans in vehicles at 
night and in poor weather. 

The image outputs 15 and 16 of cameras 11 and 12, respectively, go to a , 
weighted difference software process 1 7 or specialized hardware that fuses the 

15 outputs by performing weighted subtraction of the intensities of the two camera 
images. This weighted difference software or hardware may be referred to as a 
fuser. Such fusion of the camera ou^uts intensifies the silhouette of face 13 
and other exposed human skin in the resultant fiised image. Also, the image 
features a diminution of the background of the scene being covered by the 

20 cameras. This increased contrast between the person and the background in the 
fused image permits essentially perfect image segmentation through 
thresholding by a software process 1 8, or specialized hardware. This 
thresholding software or hardware may be referred to as a thresholder. The 
output of the thresholder 18 may go to a display 19, printer, or a post-process or 

25 specialized hardware. 

A final processed image shows the exposed skin parts, such as face 13, 
as binary blob 13', as shown in Figure 1. Background 20 of sensed face 13 is 
discounted as shown by blank background 20' in display 19. This clean-cut 
binary imagery ensures rehable and fast operation of a pattern recognition 

30 algorithm that identifies a human as indicated by face 13' imagery. 



8 
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Figure 2A illustrates the co-registration of cameras 1 1 and 12. There is 
spatial and time registration between the cameras. The cameras could be of the 
same make and model. The necessary difference between the cameras is the 
optical bandwidth filters, 48 and 49, which are situated between sensing arrays 
5 46 and 47 and camera lens 58 and 59, respectively, of cameras 11 and 12. Filter 
48 determines the 0.8 to 1.4 micron spectral sensitivity of array 46 in camera 11 
and filtCT 49 determines the 1.4 to 2.2 micton spectral sensitivity of array 47 in 
camera 12. A polarizer may be mserted in front oflens 58 ofcamera 11 and in 
front oflens 59 of camera 12. Or instead, a polarizer may be insaled between 

10 lens 58 and array 46 of camera 11, and between lens 59 and array 47 of camera 
12. Sensing arrays 46 and 47 of the cameras are the same size, for example, 512 
by 512 pixels in a gaUium arsenide substrate. Typically, the fields of view are 
the same for each array. Three pixels 51, 52, and 53, for example, are selected 
out for spatial co-registration. Each of the three pixels are focused on 

15 corresponding portions 51*, 52*, and 53*, respectively, of unage 20 viewed by 
cameras 1 1 and 12. That means the arrays have the same images, pixel for 
pixel, even Aough the spectral sensitivities are different In other words, the 
colimms and rows of pixels are aligned with the physical world scene, pixel for 
pixel. Once spatially co-registered, cameras 1 1 and 12 are kept stationary 

20 relative to the physical world. 

Time co-registration of the cameras means that the cameras are in 
synchronization with each other from a signal perspective. The signals for each 
of the two corresponding pixels go to a fi^e buffer at the same time. The 
retention of li^t for each pixel is in the micro-second range. A typical frame 

25 time is about 33 milliseconds, which is 30 frames per second. The transfer of 
pixel data may be parallel, line-by-line, or serial, pixel-by-pixel, or any other 
style of information transfer. There is a sync signal for cameras 1 1 and 12 to 
initiate and maintain their time co-registration. 

TTie image outputs or pixel signals 15 and 16 go to a software process or 

30 specialized hardware 1 7 which provides a certain weighting to each of the pixels 
and fuses pairs of corresponding pixels from cameras 1 1 and 12, respectively. 
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into single pixels. The weigjited differencing is perfonned pixel by pixel. Each 
result is the fiised pixel of Ihe two weighted differenced pixels. The weight 
difference equation for such fiising is 

P(i jWd = P(i j)towr band " C*P(i j)uppcr band- 

5 P is spectral power. The position or location of each pixel in the respective 
image is identiJBed by row 0.e., 'Y') and colunm (i.e., "j"). Hie rows and 
columns of pixels of the images of cameras 1 1 and 12 coincide with each other. 
The lower band pixels are those from camera 1 1 and the i^er band pixels are 
those from camera 12. The spectral power 'T" for each pixel at i j is indicated, 

10 for example, by a numeral scale of brightness from 0 to 255 for 8-bit resolutioiL 
"0" is entirely black or daric (i.e., no spectral power) and "255" is entirely vMte 
or bright (i.e., fiill spectral power). Numerical mdications in between 0 and 255 
are, of course, representative of various gradations of gray, brightness, or 
spectral power. of the equation is a constant (i.e., weighting factor), \^4uch 

15 is determined according to the lighting of background or scene 20 and object or 
face 13. ^^C" for daytime lighting conditions is about 3 for optimal results. "C" 
for nighttime depends upon the spectral distribution and properties of an 
artificial illuminator 14. 

The brightness or spectral power of a typical pixel of the lower band 

20 (image 46) may be 55 and the brightness or spectral power of the corresponding 
typical pixel of the upper band (image 47) may be 10. These upper and lower 
band pixel values are representative of skin in the corresponding bands. The 
spectral power of a resultmg typical fused pixel, in daytime viewing, at a 
location of row i and column j in the daytime is determined with the following 

25 calculation. 

P(ij)&sed = 55-3*10 
P(ij)i«sed = 55-30 = 25 

The fused pixel signals go from software process or specialized 
hardware 17 to software process or specialized hardware 18 for image 

30 segmentation via thresholding of the fused pixels. Process or specialized 

hardware 1 8 emulates a comparator-like circuit in that each fused pixel below a 

10 
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certain threshold value (T) is assigned a value (Vi) of 0 and each fused pixel 
above the certain threshold value is assigned a value (V2) of 255. 

Figure 3 shows a histogram of an image frame of fused pixels. The 
number of pixels for each spectral power value is indicated by curves 54 and 55 

5 for a given sensed image. The pixels of curve 54 represent background 20 and 
the pixels of curve 55 represent human skin 13. Curves 54 and 55 intersect at 
56 that is deemed to be the appropriate value for thresholding. If curves 54 and 
55 do not intersect, then the thresholding value 56 is centered between curves 54 
and 55. The threshold value is dynamic in that it changes from frame to frame, 

10 and is determined for each image frame according to the histogram of the 

respective frame. If the spectral value for fliresholding is 20, then fused pixels 
having a value below 20 are valued at 0 and fused pixels having a value above 
20 are valued at 255. The resulting image in display 1 9 has white pixels for 
background 20' and black pixels for face 13\ This image may be reversed by 

15 process or specialized hardware 1 8 such that background 20' has black pixels 
and face 13' has white pixels. 

Figure 2B shows an alternate embodiment for co-registration of the 
cameras 1 1 and 12. As shown therein, an optical device 57, e.g., a 
beamsplitter/filter device, is used to provide co-registration of the cameras. The 

20 setup is essentially the same as that shown in Figure 2A, except that the filters 
47, 48 are not provided with the cameras 1 1 and 12. Instead, filtering is 
provided by the optical device 57. 

As shown in Figure 2B, light comes from the environment through the 
beamsplittei/filter optical device 57 to the two near infrared cameras 1 1 and 12 

25 as represented by the points of light 51-53. The beamsplitter/filter optical 
device 57 is an optical device with a coating that performs optimally at a 
specific angle. The beamsplitter/filter optical device 57 directs light with 
wavelengths below 1 .4 microns (i.e., the lower band) to camera 1 1 and light 
with wavelengths above 1 .4 microns (i.e., upper band) to the other camera 12. 

30 The cameras 1 1 , 1 2 are preferably connected to a computer for processing video 
information. However, another electronic device or a human operator may be 

11 
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used as an alternative to, or in addition to, the computer device. The lower and 
upper bands are bounded either by the beamsplitter/filter optical device's 57 
sensitivity or the camera's 11,12 sensitivity. Preferably, the lower band is 0.8 
microns to 1.4 micron, and the upper band is 1.4 microns to 2.4 microns. 
5 However, other some^^1lat different ranges may work as well. 

The beamsplitter/filter optical device 57 provides at each point in time, 
two co-registered frames in the upper and lower band at the hardware level of 
flie system. Therefore, no time-consuming and generally complicated software 
to accomplish time registration is required like in the embodiment described 

10 above with reference to Figure 2B. 

Further, a computer controlled near-infrared illumination source may be 
added to the system to maintain optimal illumination levels in the scene at all 
times. For example, a photometer may be used to sense scene illumination and 
provide a signal to initiate the need for computer adjustment of the illumination 

15 source. 

As one can note here, a main appUcation of the invention is people 
detection in vehicles. However, people detection can be used at security points, 
alert areas, and so forth. An enhanced version of system 10 may be used to 
actually identify people. 

20 The spectrums in vMch cameras 1 1 and 12 function are within the 

reflected infrared portion 21 in Figure 4, which shows the EM spectrum. 
Visible spectrum 22 is the spectral sensitivity of conventional cameras. 
Unfortunately, visible light cameras have noise levels that increase during poor 
environmental conditions such as bad weather, nighttime, and direct sunlight 

25 Some problems, such as nighttime viewing may be overcome with artificial 
lighting, which matches the visible spectrum of the camera, and which in 
vehicle occupant detection is a serious distraction to drivers. Another 
disadvantage is that a human fece 13, which is the object of interest, does not 
have consistent qualities within the visible range. Vehicle occupant faces 

30 appear dark or light, depending on the physiological characteristics of the 
occupant, and the intensity and incident angle of illumination. 

12 
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The thermal infrared band 23 (3.0 to 5.0 and 8.0 to 14 microns) is 
associated with thermal properties of materials. "Hie human body is at a 
temperature of 37 degrees C. This means that human faces have a consistent 
light color in thermal infrared imaging, despite various facial colors, which is 
5 contrary to visible imaging. 

The thermal property of the body provides a clear differentiator from 
look-alike dummies. The thermal infrared sensor can function at night without 
an external ilhiminator. One disadvantage of using the thermal infrared band 23 
for occupant detection is that vehicle windshield glass greafly attenuates infiai«d 
10 light transmission at 2.8 microns and higher. 

Figure 5 reveals the transmittance characteristics of infrared light 
between 0.4 and 2.8 microns for a clean vehicle windshield (curve 24) and a 
dirty windshield (curve 25). Beyond 2.8 microns of thermal infrared bandwidth 
23, the radiation transmittance characteristic of windshield glass is ahnost zero. 
15 The transmittance of a lightly tinted side window of a vehicle is good (50 to 
85%), from 0.3 up to 2.8 microns as revealed by curve 26 in Figure 6. Between 
2.8 and 4.3 microns, the radiation transmittance is about 20 percent for the side 
vehicle window. Beyond 4.3 microns the transmittance drops to nearly zero. 
However, the spectral behavior of the side window permits transmittance of 
20 some thermal radiation. 

Curves 27 and 28 of Figure 7 show the percentage of reflectance of 
infrared light for light and daric complexion Caucasian males, respectively. The 
reflectance is good between 0.6 and 1.4 microns. Above 1.4 microns, the 
reflectance is significantly diminished. However, the difference of reflectance 
25 of light and daric complexions are minim al 

Li Figure 8, curves 29 and 30 show skin reflectance for U^t and daric 
complexions, respectively, of Asian males. Curves 31 and 32 of Figure 9 show 
skin reflectance for h ght and daric complexions of black males. Even though the 
reflectance of Ught complexions is higher than those of dark complexions; 
curves 27, 28, 29, 30, 31 and 32 of Figures 7-9, respectively, have similar 
shapes and all of them drop off at about 1.4 microns. These reflectances show 

13 
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some variation for all complexions of the Caucasian, Asian, and black males, 
between 0.6 and 1 A microns. 

Curves 33 and 34 of Figure 10 show the reflectance for more extreme 
differences of light skin and dark skin, respectively. The reflectance of light and 

5 dark skin are significant up to 1 .4 microns. After L4 microns, reflectance 

curves 33 and 34 for light and dark skin, respectively, become almost coincident 
and the resultant reflectance drop below 20 percent. Thus, in the near-infi:ared 
bands of 1.4 and above, the reflectance of detected humans of all kinds of skin 
shade, are about the same at wavelengths greater than 1 .4 microns. 

10 In Figure 1 1, curves 35, 36, and 37 show the reflectance for cotton, 

wood, and polyamide respectively, to be significant not just between 0.6 and 1.4 
microns, but beyond 1 .4 microns. The insignificant drop in reflectance after the 
1 .4 micron threshold point, is a basis that shows a large contrast in reflectance 
between the human face and inanimate objects, such as upholstery, the 

15 dashboard, and &brics in a vehicle, which are background, and provide for easy 
detection of the human fece in the range of 1.4 to 22 microns. 

Consequently, there is a significant contrast, in reflectance between the 
images of a Caucasian male and a dummy head fiom a camera operating in the 
range between 1 .4 and 22 microns. The image of the dunomy is reflective and 

20 appears rather bright and the male human image is dadc and thus the resultant 
contrast between the two images is rather stark. This person detection scheme is 
much s\q)erior to visible light imaging, since the latter scheme reveals litfle or 
no contrast i)etween the Caucasian and dununy heads of like colors. In 
summary, it is easy to distinguish images of the human head from those of the 

25 dummy head in the 1.4 to 2.2 micron range imagery, but not easy to distinguish 
the images of the respective heads from each other in the 0.8 to 1.4 micron 
range imagery. 

The lower reflectivity of human skin for the 1 .4 to 2.2 micron spectral 
range is explained by the spectral reflectance of distilled water as shown by 
30 curve 38 of Figure 12. There is a substantial drop in reflectance at about L4 
microns. Beyond 1.4 microns, the water absorbs substantial infrared radiation 
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and appears in an image as a dark body. Since the composition of the hmnan 
body consists of 70 percent water naturally, its spectral response is similar to 
that of water. So camera 12, operating in the 1.4 to 2.2 micron range, captures 
this unique human body differentiator. With the operating range of camera 12, 
5 one can safely use during nighttime a matching near-infrared illumination 
source 14 to improve the quality of the sensed image of face 13. This light is 
invisible to humans, such as vehicle drivers, but also is harmless to their eyes 
since the wavelength of illuminator 1 4 is above the safe threshold of 1 .4 
microns. 

10 Also, since cameras 1 1 and 12 of system 10 operate at a lower band than 

the mid-infirared band, glass penetration is not a problem and cameras 1 1 and 12 
can easily detect through the fix)ntal wmdshield of a vehicle. Thus, speed 
reqmrements for cameras 11 and 12 are less restrictive. In an actual highway 
site, a zoom lens would be used. 

15 Figure 13 shows a layout of a near-infrared system 40 for determining 

the speed characteristics of the human detector. A vehicle 41 may be assumed 
to be moving down a highway at a velocity v, as shown by vector 42, and be 
observed in a frontal view with a near-injfrared camera 1 1 or 1 2 at a distance d, 
as shown by line 43, and from a height h, as shown by line 44. Only one of the 

20 cameras 1 1 and 12 is needed for this evaluation, but it may be either one of 
them. Camera 11, 12 inay be a Sensors Unlimited Inc. SU 320 equipped with a 
telephoto lens, a band-pass filter m the range 1 .4 to x microns (where x > 1 .4 
microns), and a polarizing filter to reduce the glare efiFect from the sun 
illumination during daytime. 

25 During the daytime, system 40 uses the illumination of the sua The 

objective is to determine if there is any ^propriate geometric arrangement for 
camera 1 1, 12 so that the signal to noise (S/N) ratio and the camera speed are 
kept at acceptable levels even under adverse conditions. An acceptable (S/N) 
ratio is considered anything above 35. The speed quality is considered 

30 acceptable when the image smearing does not exceed the width of one pkel. 
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The first step in a radiometric computation is to determine the amount of 
radiation that falls upon the objects of interest such as the occupants of vehicle 
41 . ITie spectral band considered is above the 1 .4-micron threshold point 
Because of constraints due to the quantmn efiBciency of the camera SU-320 that 

5 was used in the actual experiments, one limits the spectral band in the range of 
L4 to 1 .7 microns. Sli^tly modified things are in effect for the extended range 
of 1 .4 to 2.2 microns. The spectral irradiance of the sun (the illumination 
source) on a clear day at sea level is approximately Isunny = 0.008 Watts/cm^ in 
the 1 .4 to 1 .7 micron band range. In this computation, however, one considers 

10 the worst case scenario of an overcast day. For an overcast day, the irradiance 
value is reduced by 10*^ thus giving irradiance at vehicle 41 of approximately 

lovercast ~ 10 * Isunny 

= 10-^*0.008 
= 8nWatts/cm^ 

15 The transmittance in this spectral range of windshield 45 of vehicle 41 is 

approximately 0.4 resulting m an irradiance on the vehicle occupants of 

loccupant "~ 0.4 * lovercast 

= 0.4 * 8 

= 32 nWatts/cm^. 

20 The second step in a radiometric computation is to determine how much 

of the incident radiation on the objects of interest is reflected back to the sensor 
(i.e., near-infirared camera 11,12). The radiance into a hemisphere assuming a 
reradiate of 0.4 would be 

RoccupgTrt 0.4 * locciqKint ^ 

25 = 0.4*3.2/71 

= 0.4 jiWatts / cm^ - steradian. 
TTiis represents the reflected portion of the occupant irradiation. He 
occi^ant's body absorbs the rest The reflected radiation has to pass through 
wLadshield 45 and the camera 11,12 lens to reach the near-infrared sensor array 
30 of camera 11,12. One assumes a 0.4 windshield transmittance, a ff2 camera 
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lens (i.e., having a 1432** cone angle) with 0.8 transmittance, a polarizer with 
0.4 transmittance, and a band-pass filter with 0.6 transmittance. Hen, the 
irradiance at the sensor array of camera 11, 12 will be 

Wa = 0.4 » 0.8 * 0.4 * 0.6 * 7C ♦ Roccopant * sia\U32^ 
5 = 0.4 * 0.8 * 0.4 * 0.6 * 71 * 0.4 * sin^(14.32**) 

= 0.006 jiWatts/cm^. 
Camera 1 1, 12 has square pixels with a side of 37.5 * 10"^ cm or an area 
A = 37.5* 10-^* 37.5* 10^ 
= 1.40 * 10-^ cm\ 

10 Consequently, the radiant power on the camera 1 1, 12 pixel will be 

Ppixd ~ A * Icamera 

= 1.4* 10-^*0.006 
= 0.084* 10-^^ Watts. 
The camera's detectivity D* is D* = 10*^ cm ^iRz I Watts. The noise 
15 equivalent power (NEP) is related to detectivity D*, pixel area A, and electronic 
bandwidth Af by the following equation: 
1SIEP = (A/Af)^/D*. 

The band\\ddth Af is determined by the exposure time of camera 11,12. 
The exposure time depends on vehicle 41 velocity 42, camera range 40, and the 
20 camera 11,12 field of view such that the images smear less than 1 pixel. 

Assuming vehicle 41 traveling at a speed of 65 mph, at a distance d 43 of 40 
meters (m) away fiom camera 1 1, 12, and with a field of view of 1.6 m, the 320 
X 240 pixel array of camera 11,12 gives a maYiimmi exposure time of 1 ms or a 
bandwidth of Af = 1 kHz. Substituting the values for A, At and D* in the 
25 formula of NEP, one gets 

NEP = 1.18* 10'*^ Watts, 
Therefore, the signal to noise ratio S/N will be 
S/N = (Ppixd/NEP) = 0.7. 

In conclusion, assuming a worst case scenario (overcast day, dirty 
30 windshield, dark occupant skin) one determines that camera 11,12, equipped 
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with a fH lens, a 1 .4 to 1 ,7 pm filter, and a polarizer, if it is positioned at a 
distance 43 of d = 40 m from incoming car 41 and at a height 44 ofh = 7 mat 
the specified distance 43, will achieve an acceptable smear of less than one pixel 
because the required exposure time of 1 ms is within the camera's speed 
5 capabilities. The signal to noise ratio (S/N) is 0.7. To boost the S/N ratio to a 
higher value on overcast days, one needs to employ an illumination source 14. 
Illumination source 14 will also be helpfiil during nighttime. If one operated in 
the visible spectrum, the use of an illuminator in the high occi^ancy vehicle 
(HO V) lane would be prohibitive. Fortunately, in this case, the spectral 

10 signature of illuminator 14 for the 1.4 to 1 .7 micron wave-band can be safely 
employed in the HOV lane. 

Post processing includes a neural network that performs automatic 
vehicle occupant detectioa The vehicle occupant detection j^proach is based 
upon a fiizzy neural network algorithm. The perfect binary image provided by 

1 5 the fusion approach described above fecilitates high correct detection rates. 

Further, with reference to sev^ previous Figures, and also Figures 14- 
20, disguise detection systems and methods are described \dierein reflection 
properties of natural human anatomy (e.g., natural skin and hair) in the upper 
band of the near-infrared spectrum are used to provide for disguise detection, 

20 e.g., the detection of the presence of artificial materials associated with the head 
of the human body. 

The human skin has extremely low reflectance m the upper band of the 
near-iirfrared spectrum (i.e., 1.4 (un and greater in the near infrared spectrum) as 
previously described herem with reference to Figure 7-1 0. SucH Figures 7-1 0 

25 showed that human skin has a higji reflectance between 0.6 and 1 .4 microns. 
However, above 1.4 microns, the reflectance is significantly diminished. Since 
almost eveiything else in a typical scene has a higher reflectance in the upper 
band of the near-infi-ared spectrum greater than 1 .4 fun, there is shaxp contrast 
between the human skin, e.g., face and neck, and the background. 

30 Further, as shown by Figures 7-10, the skin reflectance property, i.e., that 

the reflectance of human skin above 1 .4 microns in the upper band of the near 
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infrared spectrum is significantly diminished, is universal across the hmnan 
race, e.g., there is little difference in such reflectance properties above 1 .4 
microns in the upper band of the near iofrared spectrum vrfien comparing 
Caucasian, asian, and black persons. For example, Figure 7 shows a drop-off in 
5 reflectance at or about 1 .4 microns for Caucasian males, Figure 8 shows such a 
drop-off for asian males. Figure 9 shows such a drop-off for black males, and 
Figure 10 shows the drop-off for extreme differences of light skin and dark skin. 
As such, and as previously described herein, m the near-infrared band of 1 .4 
and above, the reflectance of natural skin of detected humans of all kinds of skin 
1 0 shade are about the same at wavelengths greater than 1 .4 microns. 

In contrast to the natural skin, human hair, i.e., natural hair, is highly 
reflective in the upper band of the near infrared spectrum above 1.4. Such 
reflectance is also a property that is universal across the human race. Thehighly 
reflective nature of human hair in the uppoi band of the near infrared spectrum 
15 above 1.4 microns is generally shown in Figure 17. In Figure 17, a reflectance 
diagram of natural human hair in at least a portion of the near-infrared spectrum 
is shown. Three separate reflectance measurements on a natural human hair 
specimen produced the high reflectance properties shown in the diagram. 

In contrast to tiie high reflectance of natural human hair, a reflectance 
20 diagram of a human hair hairpiece (an artificial material as later defined herein) 
is shown in Figure 18. As shown therein, in the upper band of the near-infrared 
spectrum, reflectance is much lower than natural hair. Even if true human hair 
is used to be fitted in a toupee, due to the chemical processing used in making a 
toupee, the reflective characteristics are altered. Although the difference in 
25 reflectivity when comparing a true human hair wig to true natural human hair is 
much subtler, such reflectivity differences are still substantial and can be easily 
captured. 

In addition, the reflectance of various artificial materials, such as those 
used in disguises and as generally defined below (heavy make-up, artificial face 
10 parts, add-on hair, etc.) generally have a reflectance that is significant beyond 
1 .4 microns. For example, as shown in Figure 1 1 , and previously described 
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herein, the reflectance properties for cotton, wood, and polyatnide do not drop 
significantly in reflectance after the 1 A micron point As such, there is a 
significant contrast in reflectance properties between natural human skin and 
other artificial materials, and also between natural human hair and artificial 
5 materials, in the upper band of the near infixed spectrum. 

Yet further, as previously described herein, radiation in bolh the iq)per 
and lower near-infrared bands can transmit through the window glass of 
vehicles. Therefore, this is a definite advantage compared to both the visible 
and the thermal infrared spectrums. As such, the present invention which uses 

10 the upper band of the near-infrared spectrum can detect disguised faces even 
within vehicles. The transmission characteristics through the window glass of 
vehicles is shown in the diagrams of Figures 5 and 6. As shown therein and as 
described previously herein. Figure 5 reveals flie transmittance characteristics of 
infrared light between 0.4 and 2.8 microns for a clean vehicle windshield (curve 

15 24) and a dirty windshield (curve 25). Beyond 2.8 microns at the beginning of 
the thermal infrared bandwidth, the radiation transmittance characteristic of 
windshield glass is almost zero. However, tranianittance at less than 2.4 
microns is very good. The transmittance of a lightly tinted side window of a 
vehicle is good (50 to 85%), from 0.3 iq> to 2.8 microns as revealed by curve 26 

20 in Figure 6. As such, transmittance levels in the upper band of the near-infrared 
region below 2.8 microns are very good. 

The present invention uses at least a portion of the upper band of the 
near infrared spectrum. As used herein, the upper band of the near-infrared 
spectrum includes the range from 1.4 microns to 2.8 microns. As previously 

25 indicated herein, at 2.8 microns thermal ^ergy begins to appear. Preferably, 
according to the disguise detection systems and methods described herein, at 
least a portion of the upper band of the near-infrared spectrum within the range 
of 1 .4 microns and above is used. More preferably, at least a portion of the 
upper band of the near-infirared spectrum within the range of 1 .4 microns to 2.4 

30 microns is used. Yet more preferably, at least a portion of the upper band of the 
near-infrared spectrum within the range of 1 .4 microns to 1 .7 microns is used. 
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One skilled in the art will recognize that slightly shorter or longer ranges 
can also yield acceptable detection results. For example, with respect to the 
ranges given above, a deviation from such wavelength values which may 
produce acceptable detection results is contemplated to fell within the specified 
5 ranges. 

Further, as used herein, artificial materials include any materials other 
than natural skin and/or natural hair, such as those items or materials used for 
disguise purposes. For example, wigs, make-up materials, artificial nose pieces, 
etc., formed from one or more artificial materials or inanimate objects such as 

10 polymers, fibers, etc., are referred to herein as artificial materials. Further, 
background objects are also referred to herein as artificial materials, e.g., a car 
behind a person, clothing of a person, etc. 

Generally in disguise situations, an mdividual alters his or her facial 
appearance through the addition/q>pIication of a fake nose, make-up, wig, 

15 artificial eyelashes, and the like. Professional actors routinely use this method 
for needs of their actii^ roles. A well done disguise by this technique is very 
difficult or ioipossible to be detected in the visible spectrum. Generally, the 
face has been touched with a make-up material to integrate smoothly the fake 
nose. Although disguises are usually very simplistic, the facial appearance of 

20 the person changes substantially. As such, there is no way to visually detect the 
deception without prior knowledge. 

Detection systems and methods described herein are able to detect 
disguises due to the feet that any artificial materials applied to the head of the 
human, e.g., facial skin or scalp, alters to various detectable degrees the 

25 respective xmique infrared signatures of such humans, particularly in the upper 
band of the near-infirared spectrum. Therefore, although disguise configurations 
can easily fool the eye in the visible spectrum, such disguises are inamediately 
apparent in the i^per band of the near-infrared spectrum. 

The reflectance characteristics of various artificial materials, and also 

30 natural hair and natural skin of the human body, as described above can be more 
clearly understood through the display of such reflectance characteristics as 
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shown or described further below with reference to Figures 14A-B and Figures 
15A-B» Figure 14A shows an undisguised human head 102 in a visible 
spectrum. The human head 1 02 includes a facial portion 114 of natural skin and 
natural human hair 112 including a beard, a miistache, eyebrows, and scalp hair. 
5 Figure 1 4B shows the undisguised human head 1 02 in &e upper band of 

the near-infimed spectrum based on the reflectance properties in the scene. In 
the upper band of the near-infiared spectrum, die natural human skin of the 
facial portion 114 has a dark appearance due to its low reflectance 
characteristics. On the oth^ hand, the facial hair 112 including the beard, 

10 mustache, eyebrows, and scalp hair has a bright appearance due to its highly 
reflective iiature in the upper band ofthenear-infiared spectrum. As such, the 
undisguised person has a unique near-infrared signature due to the reflectance 
characteristics of the person's natural hair and natural skin in the upper band of 
the near-infiared spectrum. As previously described herein, such characteristics 

15 are universal for the entire human species. 

Figure ISA shows a disguised human head 106 in the visible spectrum. 
The disguised human head 1 06 includes a fecial portion 116 having natural skin 
but with a fake nose 117 fitted thereon and touched up by make-up. Further, the 
disguised human head 106 includes a wig 118 covering the scalp of the human 

20 head and a fake beard 108. Natural hair components 119 include the eyebrows 
and mustache. 

Such a disguise is not detectable in the visible spectrum, as shown in 
Figure 1 5 A. However, the artificial materials alter radically the signature of the 
person's head in the upper band of the near infirared spectrum. As a result, 

25 facial skin appears very bright in the area ofthe fake nose 117,andisan 

obvious abnormality in the iqjper near-infirared band as shown in Figure 1 5B. In 
contrast, the artificial hair wig and beard has much lower reflectivity than 
natural human hair in the upper band ofthe near-infirared spectrum. As a result, 
the artificial hair 108, 1 18 of the hiunan head 106 appears very dark in the 

30 image, due to its low reflectivity, and the natural hair, i.e., the mustache and 
eyebrows 119, appear bright 
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Such abnormalities are readily detectable, as can be seen in Figure 1 5B. 
In Figure 15B, the human head 106 shows the abnormal dark hair 118 covering 
the scalp and abnormal dark beard 108. If such hair were natural hair, it would 
have a similar brightness as that shown in Figure 14B and like the natural hair 
5 119 including the eyebrows and mustache. Likewise, further, the artificial 
materials used to form the fake noise 117 are clearly abnormal due to ttteir high 
reflectivity compared to the other natural skin facial portion 1 16. 

As described above, it can be readily seen Aat an imagmg system based 
on the reflectivity in the iqrper band of the near-infiared spectrum provides 

10 advantageous disguise detecting ability. Such a system and metiiod is based on 
various reflectivity characteristics in the iq>per band of the near-infiared 
spectrum. Such charactmstics include at least: that the human skin has very 
low reflectivity in the upper band of the near-infiared spectrum and always 
ranks amongst the da±est objects in the scene; that artificial materials, e.g., 

15 facial disguise materials, feature high reflectivity in the upper band of the near- 
infrared spectrum and always rank among the brightest objects in the scene and, 
as such, vAxm they are applied to natural skin and hair of the human head, they 
alter totally its phenomenology and facilitate easy detection in the imagery by a 
human observer or a machine vision system; that the natural human hair has 

20 high reflectivity in the upper band of the near infi-ared spectrum and always 
ranks amongst the brightest objects in the scene; and fiirther that artificial hair 
or even true human hair wigs feature low reflectivily in the xxpper band and 
always rank amongst the darkest objects in the scene and, as such, wiien they are 
^plied to the scalp or to the face of a human head, they alter totally the 

25 expected phenomenology and facilitate easy detection in the imagery by a 
human observer or a machine vision system. 

Figure 16 shows one illustrative embodiment of a disguise detection 
system 130 according to the present mvention. The disguise detection system 
130 includes circuitry 132, an upper near-infirared camera 134, a photometer 

30 140, an upper near-infrared illuminator 136, and a computer-controlled power 
supply 138. The iq)per near-infrared camera 134 may be a camera like that 
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previously described herein with reference to Figures 1 and 2. The camera is 
sensitive to at least a portion of the upper band of flie near-infiared spectrum, 
preferably m the range of 1 A microns and above, more preferably in the range 
of 1 .4 ndicrons to 2.4 microns, and even more preferably in the range of 1 .4 
5 microns to 1 .7 microns in the upper band of the near-infrared spectrum. Such 
cameras generally have a sensing array, for example, an array of pixels that 
provide signals based on the light captured thereby, as is readily knoAvn to those 
skilled in the art The pixel signals representative of the image based on the 
light captured is provided to circuitry 132. For example, the uppQx near-infrared 

10 camera may be a camera available from Sensors Unlimited, under the trade 
designation SU-320. 

Preferably, chcuitry 132 includes a computer system 133 operable to 
execute software to provide a user with information as to the presence of an 
artificial material associated with the head of the human body based on the 

15 detected reflection in the upper band of the near-infrared spectrum. Although 
the circuitry 132 may be implemented using software executable using a 
computer apparatus, other specialized hardware may also provide the 
fiinctionality required to provide a user with information as to the presence of an 
artificial material associated with the head of tiie human body, e.g., information 

20 concerning a disguise. As such, the term circuitry as used h^ein includes not 
only specialized hardware, but may also include circuitry such as processors 
capable of executing various software processes. 

For example, the computer system 1 33 may be any fixed or mobile 
computer system, e.g., a personal computer or a minicomputer. The exact 

25 configuration of the computer system is not limitin g and most any device 

capable of providing suitable computing c^abihties may be used according to 
the present inventioDL Further, various peripheral devices, such as a computer 
display, a mouse, a keyboard, memory, printer, etc., are contemplated to be used 
in combination with a processing apparatus of the system. 

30 The detector or photometer 140 is operable to detect an illimiination 

level proximate the head of the human body which is in the scene being 
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C£q)tured by camera 134. Hie photometer 140 provides information to the 
computer system 133 based on the detected illumination level. The computer 
system 133 is operable to control the upper near-inj&ared illuminator 136 \^*ich 
is an illumination source matched to the upper band of the near-infiared 
5 spectrum used to perform the metiiod according to the present invention. The 
upper near-infrared illuminator 136 is positioned to illummate at least a portion 
of the head of the human body, e.g., the scene in which the human body is 
located. The circuitry 132. e.g., the computer system 133, is operable to control 
the upper near-infrared illuminator 136 based on the detected illumination level 
10 provided by the photometer 136 to maintam a desired illumination level of the 
head of the human body, e.g., illumination of the scene in which the human 
body is located, hi one embodiment, software of computer system 133 may be 
used to automatically adjust the illumination level of the upper band near- 
infrared iUuminator 136 to maintain an optimal illumination level m the scene at 
all times. The adjustment of the illumination level is based on the readings from 
photometer 140 and may be realized through power supply 138. 

The iUumination assists in the production of a high quality hnaging 
signal from the camera 134, even during overcast days and at night Such 
illumination can be used because the scene can be safely illuminated with such 
20 eye-safe near-infrared illuminators. Also, since the eye is not sensitive to the 
near-infrared spectrum, the system remains stealth at aU times. Any suitable 
photometer and illuminator may be used to provide for suitable illumination of 
the scene in which the human body being captured by the camera 134 is located. 

Both the camera 134 and illuminator 137 may be moved by any suitable 
structure represented by arrows 135 and 137, respectively, such that a larger 
field of view may be possible. For example, the camera 134 may be moveably 
mounted for capturing images in a 180" field of view, and Ukewise iUuminator 
1 36 may be moved so as to provide adequate iUumination to achieve an imaging 
signal from camera 134 of sufficient quality to perform disguise detection. 

Using a detection system such as, for example, the disguise detection 
system 130 of Figure 16, various methods of deteimining Ihe presence of an 
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artificial material associated with the head of the human body based on the 
detected reflection may be performed. Two illustrative embodiments of such 
methods are diown in Figures 19 and 20. The method 150 shown in Figure 19 
provides for detection by a human observer, such as by viewing displayed 

5 images as shown in Figures 14 and 15. Figure 20 shows an illustrative 

embodiment of a method 160 which mcludes additional processing of the data 
to provide additional information to the user other than just displayed images, 
e.g., such as information that may be provided using a machine vision system, 
or oth^ information instead of displayed images. 

10 The method 150, illustratively shown in Figure 19, will be described 

with reference to the displayed images of Figures 15A and 15B. The method 
150 includes initiatiiig the disguise detection system (block 152). Upon 
initiatmg the disguise detection system (block 152), image data representative of 
the reflection in at least a portion of the upper band of the near-infirared 

15 spectrum is captured by camera 134. The reflection data fiom camera 134, e.g., 
pixel signal data, is provided to the circuitry 132, e,g., a computer system 133, 
which may operate on the data using a thresholding process (block 1 54) so as to 
manipulate the data and to provide an image to be displayed for viewing by a 
user (block 156). 

20 Various thresholding techniques have been used as is readily known to 

those skilled in the art Any suitable thresholding process that provides for 
acceptable segmentation of dark and light regions may be used according to the 
present invention. In general, such thresholding processes compare the data 
representative of the reflection to one or more thresholding values. Such values 

25 may be based on a variety of fectors, such as the reflection characteristics of 
natural skin, of natural hair, etc. For example, a thresholding process described 
in the article entitled "A Threshold Selection Method fix)m Gray-Level 
Histograms" by Otsu, IEEE Transactions on Systems, Man And Cybernetics^ 
Vol. SMC-9, No. 1, January 1979, may be used according to the present 

30 inventioiL The thresholding process generally involves a non-parametric and 
xmsupervised method of threshold selection. An optimal threshold is selected so 
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as to maximize the separability of the resultant classes in gray levels. The 
algorithm utilizes only the zeroth-order and the first-order cumulative moments 
of the gray level histogram. The speed of the system, in part because of the 
thresholding process, can provide real time images to the user. 

5 The user vAusol presrated with the displayed im^e such as shown in 

Figures 14B and 15B (block 156) can then view any abnormal characteristics of 
the image, e.g., the bright nose feature 117 representative of a feke nose, the 
daric facial hair features 108 and 1 18 which are abnormally dark compared to 
natural hair, etc. as shown in Figure 1 5B. Upon detection of such abiiormalities 

10 by the user, appropriate action m^ be taken. Such action may include the 
sounding of an alarm, direct contact with the disguised individual, etc. 

In such a method 150, there may be a direct correlation between the level 
of reflectance and the brightness of features like that represented in Figure 15B, 
e.g., high level of reflectance being shown as bright feature. However, 

1 5 additional processing in conjunction with the thresholding process may be used 
to display detected artificial materials in any differentiating manner. For 
example, the skin 116 may actually be represented as a first shade and the nose 
being abnormally represented as a different shade easily recognized by a user. 
For example, the brightness of the portions of the image may be reversed from 

20 that shown in Figure 1 5, e.g., the fake nose is dark and the skin is brighter than 
the fake nose. 

The method 160, illustratively shown in Figure 20, includes initiating the 
disguise detection system (block 1 62). Once the data has been captured by 
camera 134 and provided to the computer system 133, the reflectance data, e.g., 

25 pixel signal data, &om camera 134 is analyzed (block 164). The data may be 
analyzed in one or more diJBerent manners. 

In one illustrative embodiment, for example, the data may be compared 
to one or more threshold levels. The one or more threshold levels (block 166) 
provided for comparison to the reflection data may be threshold levels based 

30 simply on the natural skin and natural hair reflectance characteristics. However, 
such threshold levels may also be based on a plurality of reflectance properties 
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of the artificial materials themselves used in disguises. As such, tiie reflectance 
characteristics of a number of known disguise materials can be mapped into a 
multi-level thresholding algorithm. With use of such a multi-level thresholding 
algorithm, not only can detection of disguises be attainable, the detection and 
5 existence of specific materials used in the disguises may be obtained by tibe 
detection of reflectance and comparison using the multi-level thresholding 
algorithm. 

For example, reflectance measurements in the upper band of the near- 
infrared spectrum may be gathered for all known possible disguise materials 

10 used in the trade. A direct m^ing between different artificial materials and 
thresholding levels corresponding to a particular reflectance characteristic can 
be performed. Likewise, various other disguise situations may be mapped. For 
example, a list of &cial images featuring just a single disguise item, e.g., a fake 
mustache only or a heavy make-iq) only, may be m^ped. As will be 

15 recognized, the list of disguises which may be m^ped is imhrnited, however, a 
multi-level thresholding scheme can be developed that may be used to identify 
any number of various disguises. As such, with the use of a m\ilti-level 
thresholding scheme, the identification of one or more artificial materials 
associated with the head of the human body can be identified and the user 

20 alerted to the presence of such artificial materials (block 1 68). For example, 
upon comparing the reflection data from the camera 134, with use of computer 
system 1 33, to such a multi-level threshold reference map, an alert may be 
presented to the user indicating the presence of an artificial material associated 
with the head (block 168). The user may then take appropriate action. 

25 The usermay be alerted many mmiber of ways. For example, 

information may be displayed, a silent alarm may be used, an audio alarm, a 
tactile alarm, etc. Such information displayed may include, for example, an 
alarm mechanism, information as to the disguised person, the disguised 
materials being \ised, and/or the level of security risk involved with the 

30 disguised person. 
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It will be recognized that various methods aad systems described herein 
may be used in combination and/or such methods and systems may be used in 
combination with other detection systems. For example, in one illustrative 
embodiment of such a combined system according to the present invention, 

5 reflections ftom a scene in at least a portion of one band of the near-infiared 
spectrum may be detected. The presence ofthe head ofllie human body in a 
scene may be determined based on the detected reflection in the portion ofthe 
one band of the near-infrared spectrum, e.g., segmentation ofthe head from the 
background of a scene. Thereafter, the reflection from at least one portion of 

10 the head ofthe human body in at least a portion of an iq>per band of the near- 
infrared spectrum may be detected to determine the presence of an artificial 
material associated witiii the head of the human body based on such reflection. 

For example, such a combination system and method may be 
implemented using the two camera system previously described herein. For 

15 example, the dual band near-infrared method may be used for face detection for 
the location of a head. Thereafter, the disguise detection mefliod may be used to 
determine the presence of an artificial material. 

Further, for exanq>le, in another embodiment of such a combination 
system and method, the head may be determined to be present by detecting the 

20 reflection fix)m a scene in at least a portion of flie upper band ofthe near- 

infimed spectrum. For example, the upper band of the near-infrared spectrum 
within the range of 1.4 ^un to 2.2 \xm may be used to determine the presence of 
the human head such as described previously herem, e.g., \^ilereia a dummy 
head is differentiated from the human head or a human head is differentiated 

25 form a background. Further, thereafter, it may be determined xi^diether the 
human head is disguised also using the upper band of the near-infiared 
spectrum, as previously described herein. 

Such methods and systems may be used in combination with other 
systems and methods such as those that employ thermal iofirared detection. 

30 Thermal infirared detection may be used for detecting cosmetic surgery 
disguises. Such cosmetic surgery disguises may not be detectable by the 
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disguise detection process using the upper band of the near-infrared spectrum, 
as previously described herein. Likewise, visible spectrum systems may be used 
in combination with the previously desmbed methods and systems herein so as 
to enhance detection capabilities. 
5 All patents and references cited herein are incorporated in tiieir entirety 

as if each were incorporated separately. Although the invention has been 
described with particular reference to the preferred embodiments thereof 
variations and modifications of Ihe present invention can be made within a 
contemplated scope of the claims, as is readily known to one skilled in the art 
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What is claimed is: 

1 . A method for use m detection of a person disguised with one or more 



detecting reflection firom at least one portion of a head of a human body 
in at least a portion of an upper band of the near injBrared spectrum; and 

determining the presence of an artificial material associated with the 
head of the human body based on the detected reflection. 

2. The mefliod of claim 1, wiierem the at least a portion of the iq)per band 
of the near infi^ spectrum is at least a portion within the range of 1 .4pm and 
above in upper band of the near infrared spectrum. 

3. The method of claim 2, wherem the at least a portion of the upper band 
of the near mfrared spectrum is at least a portion widiin the range of 1 .4pm to 
2.4pm in the iq)per band of the near infrared spectrum. 

4. The method of claim 3, v^erem the at least a portion of the upper band 
of the near infrared spectrum is at least aportion within the range of L4pm to 
1.7pm m the upper band of the near infrared spectrum. 

5. TTie method of claim 1, wherem detecting reflection comprises detecting 
reflection from at least a skin portion of the head of the human body. 

6. The method of claim 1, \dierein detecting reflection comprises detecting 
reflection from at least a hair portion of the head of the human body. 

7. The method of claim 1, wherein detennimng the presence of an artificial 
material associated with the head of the human body comprises displaying to a 
user a representation of the detected reflection of the at least one portion of the 
head of the human body. 



artificial materials, the method comprising: 



31 




wo 01/95247 PCT/USOl/18371 

8. The method of claim 1 , wherein determining the presence of an artificial 
material associated with the head of the human body comprises: 

generating data representative of the detected reflection; and 
5 comparing the data to at least one threshold reference reflection level. 

9. The method of claim 8, wherein generating data repres^tative of the 
detected reflection comprises focusing the reflection on a pixel array that is 
sensitive to the at least a portion of the upper band of the near infirared spectrum, 

10 and generating a signal representative of the spectral power for each of a 

plurality of pixels of the pixel array to be used for the comparison to the at least 
one threshold reference reflection level, 

10. The method of claim 8, wherein the at least one threshold reference 
15 reflection level is based on a level of reflection of the one or more artificial 

materials. 

1 1 . The method of claim 1 0, wherein the at least one threshold reference 
reflection level is a plurality of reference reflection levels corresponding to a 

20 plurality of artificial materials, and fiirther wherein the method comprises 

identifying one or more of the artificial materials associated with the head of the 
human body. 
» 

12. The method of claim 8, wherein the at least one threshold reference 
25 reflection level is based on a level of reflection of natural skm of the human 

body. 

1 3. The method of claim 8, wherein the at least one threshold reference 
reflection level is based on a level of reflection of natural hair of the human 

30 body. 
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14. The method of claim 1 , wherein the method further comprises 
illuminating the at least a portion of the head of the human body iising an 
illumination source matched to the at least a portion of the upper band of the 
near infrared spectrum. 

5 

1 5. The method of claim 14, vdierem the method fiirther comprises; 
detecting an illumination level proximate the head of the human body; 

and 

controlling the illumination source based on the detected illumination 
10 level to maintain a desired illumination level on the head of the human body. 

16. A disguised person detection system comprising: 

a detector apparatus operable to detect reflection from at least a portion 
of a head of a human body in at least a portion of an iq>per band of the near 
15 infrared spectrum; and 

an indication apparatus operable to provide a user with information as to 
the presence of an artificial material associated with the head of the human body 
based on the detected reflection. 

20 1 7. The system of claim 1 6, wherein the at least a portion of the iqiper band 
of the near infrared spectrum is at least a portion within the range of 1 .4^m and 
above in the upper band of the near infrared spectrunL 

18. The system of claim 17, \dierein the at least a portion of the upper band 
25 of the near infi-ared spectrum is at least a portion within the range of 1 Aim to 

2.4pm in the upper band of the near infrared spectrum. 

19. The system of claim 1 8, wherein the at least a portion of the \xpipet band 
of the near infi-ared spectnun is at least a portion within the range of 1 .4|xm to 

30 1 .7fmi m the upper band of the near infrared spectrum. 
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20. The system of claim 16, wherein the indication apparatus comprises a 
display operable to provide a representation of the detected reflection of the at 
least the portion of the head of the human body. 



5 21 . The system of claim 16, wherein the system further comprises a display 
operable to provide a representation of the detected reflection of the at least the 
portion of the head of the human body for use in presenting the faiformation as 
to die presence of an artificial material associated with he head of the human 
body. 

10 

22. The system of claim 1 6, ^^4lerein the detector apparatus comprises one or 
more pixels sensitive to the at least a portion of the upper band of tiie near 
infimed spectrum and operable to provide information representative of the 
detected reflection from the at least the portion of the head of the human body, 

15 and further wherein the indication apparatus comprises circuitry operable to 
compare the information representative of the detected reflection to at least one 
tiireshold reference reflection level. 

23. The system of claim 22, wherein the at least one threshold reference 
20 reflection level is based on a level of reflection of the one or more artificial 

materials. 



24. The system of claim 23, wherein the at least one threshold reference 
reflection level is a plurality of reference reflection levels corresponding to a 

25 plurality of artificial materials, and further wherein the circuitry of the indication 
apparatus is operable for use in identijfying one or more of the artificial mat^als 
associated with the head of the human body. 

25. The system of claim 22, wlierein the at least one threshold reference 
30 reflection level is based on a level of reflection of natural skin of the human 

body. 
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26. The system of claim 22, wherein the at least one threshold refeence 
reflection level is based on a level of reflection of natural hair of the human 
body. 

5 27. The system of claim 1 6, wherein the system further comprises an 
illumination source matched to the at least a portion of the upper band of ftie 
near infrared spectrum positioned to illimunate the at least the portion of the 
head of the human body. 

10 28. The system of claim 27, \^ile^ein the system further comprises a detector 
operable to detect an illumination level proximate the head of the human body, 
and further wherein the mdication apparatus comprises circuitty operable to 
control the illumination source based on the detected illinnination level to 
maintain a desired illumination level of the head of the human body. 

15 

29. A detection method comprising: 

detecting reflection &om a scene in at least a portion of one band of the 
near infrared spectrum; 

determining the presence of a head of a human body in the scene based 
20 on the detected reflection in the at least a portion of the one band of the near 
infrared spectrum; 

detecting reflection from at least one portion of the head of the himian 
body in at least a portion of an vapper band of the near infrared spectrum to 
determine the presence of an artificial material associated with the head of the 
25 human body based on the detected reflection from at least one portion of the 
head of the himian body. 

30. The method of claim 29, wherein detecting reflection from a scene in at 
least a portion of one band of the near infrared spectrum comprises detecting 

30 reflection from the scene in at least a portion of a lower band of the near 
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infrared spectrum and from the scene in at least a portion of an band of 
the near infrared spectrum. 

31. The method of claim 30, wherein the at least a portion of the lower band 
5 ofthe near infimed!q)ectnmi is at least a portion within the range of O.Spmto 

lA\m in the lower band of the near infrared spectrum, and further wherein the 
at least a portion of the upper band of the near infrared spectrum is at least a 
portion within the range of 1.4pm to 2.2pm in the upper band of the near 
infrared spectium. 

10 

32. The method of claim 29, wherein detecting reflection from a scene in at 
least a portion of one band of the near infrared spectrum comprises detecting 
reflection from the scene in at least aportion of the i^er band of the near 
uifrared spectrum. 

15 

33 . The method of claim 32, v^dierein the at least a portion of the upper band 
of the near mfrared spectrum is at least a portion within the range of 1.4pm to 
2.2pm in the upper band of the near infrared spectrum. 

20 34. The method of claim 29, wherein detecting reflection from at least one 
portion of a head of a human body in at least a portion of an xspipcr band of the 
near infrared spectrum comprises detectmg reflection from at least one portion 
of a head of a human body in at least a portion within the range of 1 .4pm to 
2 .2pm in the upper band of the near infrared spectrum. 



35. The method of claim 29, \^erein detecting reflection from at least one 
portion of a head of a human body comprises detecting reflection from at least a 
skin portion of the head of the human body. 



25 



30 
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36. The method of claim 29, wherein detecting reflection from at least one 
portion of a head of a human body comprises detecting reflection from at least a 
hair portion of the head of the human body. 

5 37. Ite method of claim 34, i^erein to determine the presence of an 
artificial material associated with the head of the human body a representation 
of the detected reflection of the at least one portion of the head of flie human 
body is displayed to a user. 
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